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REDUCING THE VARIABILITY OF ESSAY EXAMINATION 
MARKS THROUGH ELIMINATING VARIATIONS 
IN STANDARDS OF GRADING 


VARIATIONS in the marks assigned by different teachers to the trad 
tional or essay examination have commonly been assumed result from 
the subjective nature of the pupil response, but several investigators have 
be due not 


called attention to the fact that the variability found may 
only to the subjectivity of the materials being marked but also to differ 


ences In the standards of grading found among school systems and among 


teachers within a system. The first sort of variation results trom ** varia 
ble’ errors, and presumably could be reduced by inereasing the ob 
jectivity of the marking or by Increasing the sampling; but variations 
of the seeond sort are indicative of constant > errors and neither i 


creased objectivits nor mereascd sampling would nec ssarily affe;-t them 
Before the essa examination can be properly evaluated, certainly by 
fore it can be compared with new-type tests, these two kinds of variations 
must be identified, and, if possible, separated 
The more or less constant nature of the variations in standards ot 
grading Sugyvests that it shor ld possible To make some correction lol 
them. Starch,’ in his pioneer work with the essay examination, recog 
nized this facet and by compelling teachers, marking a set of Englis! 
compositions, to use a seale of 5 points and to conform to the normal 
probabiltts eurve, he was able to reduce the mean deviation trom the 
average of several marks from 4.2 to 2.8, and the average range trom 


the highest To the lowest mark viven trom 14 to il - 
(‘ontinued opposition to the arbitrary use of the normal curv and 
the possibility of further reduction of the variability by means of a more 


refined procedure, in addition to the advisability ot verliving Starch s 


*Starch, D. ‘*Can the Variability of Marks Be Reduced?’’ Schoo 


Il ¢ August, 1915 p. 242-245 


I 
» 
a 
5 
gt 
3 
VERNER M Ix Sims 
] 
037 
a ay 


JOURNAL OF EDUCATIONAL RESEARCH [ Vol. 26, No 


findings for different tvpes of subject matter and with larger groups 
seemed to Justify further experimentation 

This paper reports an attempt to eliminate the variability resulting 
from differences In standards of grading through treating the marks 
given to essay examination papers as raw scores and by means of a 
purely objective technique transmuting them to grades or school marks. 

The data upon which the study was based were: (1) the marks given 
by twenty-one teachers to a set of twenty-four examination papers in 
sixth grade arithmetic, reported by Bolton; (2) the marks given by 
twenty-five teachers to a set of twenty-five examination papers in high 
school algebra, reported by Shriner ; (3) the marks given by twenty 
five teachers to a set of twenty-five examination papers in freshman 
high-school English, also reported by Shriner ; and, (4 the marks 
given by nine readers te a set of twenty examination papers in general 
psve hology, collected by this writer. 

The marks given on each of the examinations were reported in per 
centages, that is, on the basis of 100 points. The readers used by Bolton 
were teaching sixth grade arithmetie in the schools of Seattle. Washing 
ton. Shriner's readers were either teaching, or were advanced students 
preparing to teach the subject. They were seattered throughout Ohio. 
Michigan and Indiana. The psychology papers were marked by three 
instructors In psychology, two ‘readers’ in the Department of Psychol 
oxy, and four honor students enrolled in the course at the University 
of Alabama. The studies of Bolton and Shriner were the only ones 
found in recent literature where the marks assigned by different readers 
to #@ set of papers were actually reported. These marks are not repro 
duced here, but may be found in the articles referred to above. Sine 
the psvehology marks have not been previously reported they are pre- 
sented in Table I. 

If we define objectivity as agreement among competent judges as 
to the position a paper occupies in a group, the results of these studies 
indicate a higher degree of objectivity for the essay eXamination than 
most of the earlier experimenters have claimed. The average correla 


tion of each reader with the average of all readers for the set of algebra 


Bolton, F E ‘* Deo Teachers’ Marks \ ary as Much as Suppos ar’? Fadi cation, 
ALVIIL (September, 1927), pp. 28-39 Bolton reports the marks of twenty-two 
te ers, but one reeord was incomplete and has here been discarded 

Shriner, W.O. ‘*Comparison Factor in the Evaluation of Examination Papers,”’ 
Teachers Colleae Jo al, January, Taso), pp 65-74. 
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TABLE I 
SHOWING MARKS ASSIGNED BY NINE READERS TO A SET OF TWENTY GENERA! 
PSYCHOLOGY PAPERS 


Reader 
Student 
number 4 B Cc dD k F G H I Rang 
a4 4 74 a2 xT 
62 Qa 74 72 62 74 1 
17 iu 7 1 
has sl t 77 64 67 71 17 
77 HA 61 “a 7 ' 9 
6 8 67 ‘4 17 41 1 
47 49 65 43 69 4 
67 t R2 64 7 7 68 2 
aR a6 ) o4 86 1 
ss 79 77 77 78 68 2 
62 6 65 ri 44 72 
aR 91 ) 86 Q 19 
7s R7 7 67 62 
1 6 6 62 62 71 2 21 
7 72 1 78 67 
62 63 4 t 1s 
7 81 s 71 7 71 $2 
Correlation wit! 
average mark 95 97 88 9 , 92 87 1 BS 
Number failed 6 l f 2 1! 
papers was ~ 946. with a range trom 267 to +.970: for the set of 
English papers +.917, with a range trom ~ S818 to +.958; for the 
psychology papers 7 91. with a range trom ~* 7 to .97. Bolton did 


not report these correlations for his data, and sinee it Is not our purpos 
here to study the correlation between a reader and the average of all 
readers we have not bothered to ealeulate them, but inspection of the 
several markings shows even higher agreement among the readers of the 
arithmetic papers. 

Such results would seem to indieate that for these readers at least 
there was decided agreement as to the relative merit of the respective 
papers. In spite of this seeming objectivity, the variability of the marks 
viven the individual papers by the various readers was extremely great 
The average range from the highest to the lowest mark given each of the 
twenty-four arithmetic papers was twenty -six points and for one pape! 
this range was forty-five points (from 25 to 70). The average range 0! 
marks on the algebra papers was twenty-seven, the marks given one 
paper ranging fifty points from 39 to 85). The average range tor the 


English papers was twenty-one and for one paper the range was thirty 


4 
5 
a 
us; 
Sra 


TT ts (from 30 to 7S Phe average and maximum range for ft] 
cholog ers were 2S and 50 to 67), respectively When t 
‘ 1} yr marks yviven the different teachers is considered 
tv is just as great. For the algebra examination the num 
lures assigned by the different teachers ranged from 2 to 1 
ereent to 64° percent tor the English examination the range ot 
eS s from 1 to 14 (4 percent to 56 percent), and for the ps 
ov mination this range was trom 1 to 11 (5 pereent to 55 peo 
Bolton did not report the passing mark assigned by the teachers 
marked the arithmetic papers but there is every reason to believ 
t the range « lures would ive been Just as great with this ex 
titi 
When one reealls t ailures and honors, that our estimates of stu 
t ability wot elative and absolute, are commonly based upon the 
rKS by teachers the slgnificance of this variability becomes 
en No matter how high the correlations among different markings 
he, so long as such variations in the 


\ss ming a 


ip seores The proceedure involved locating the passing score at 
» standard deviations and then graphing the relationship between 
s and grades The steps mm the process are 

Loeate the lowest 


flerent teachers exist 
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sted 


rmanes without 
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marks given the same papers 
one cannot eall the examination 


Satisfactory 
lo eontre nad That to a 


certain extent school 


marks determined 
objective eXaminations 


are subject to the same sort ot 


is but to bew the question. 


portion of this variabilitv to be due to variations in th 


have attempted to eliminate it 
procedtre tor converting the 


through using 
marks of each reader, the scores 


Nume rous writers have pointed out that the per formanee of 
Troup is the mily objective basis possible tO use tor this ur 
cannot decid upon what is high performance, or what is low 
considering the performance of the group. Else 
writer has proposed an objective method of converting scores 


score 114 standard deviations 
oWest passing score as the origin, lay off in equal steps 


ve rtieal OT a eraph the possible SCOTS, 
the lowest pa 


assing grade used in the particulor system as 


M. ‘<A Simple Technique for Converting Test Scores to Percentag 
Society, XNXIIT (May, 1951), pp. 596-508 
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the origin, lay off on the horizontal axis 01 this graph distances 
corresponding to the possible grades 
Draw a diagonal through the origin and the pornt corresponadime 


pereent 


to the maximum possible score and 100) 


To find thie qrade ofa parte ular score: Read across to the diagonal 
and up or down to the percentage Line 
1 test 


Although designed primarily for use im converting objectin 


“cores to grades, the writer suggested that this iechnique should be 
marks given by the 


jicable to essay examinations If one hut treat the 


the maximum possible score one hundred pomts 


renders as scores with 
f the same lowest passing grade was consistently used, grades thus © 
tained for the same papers sl ould be free of variations resulting from 
differences in standards of grading and any variability remaining would 


presumably be due to the subjectivity of the scoring process 


by means of the procedure outlined above, the marks given by the 
different readers to the four sets o1 examination papers mentioned rm 
converted to percentags erades with 70 percent as the lowest passing 
erade. 

To what extent does this conversion reduce the variabilits Sup 


nosediv with a purely objective test, where each reader's marks were 
distributed normally, the variations would be completely eliminated 
Practically, the results for the four exammations 


ive as shown bye low 


seores Is com 


For each of the examinations the variability o! the 


nared with the variability of the grades by presenting 1) the range 


0 ihe scores and the range ol the erades assigned to the Individual 
papers the various readers the probable error of the scores and 
of the grades assigned each paper; (3) the variation from reader te 


reader in the number failed by scores and the number failed by grades 
Finally. an attempt is made to interpret and evaluate the variability 
whieh remains by determining the amount of actual misplacement (de 
viation from the average grade) found when the various readers” marks 


are Conve rted to grades. 
In order to show the reduetion in the range of the me 
apers that resulted from changing the scores to gra 


the various 
ot the range ol erades 


quenes distributions of the range ot seores and 


assigned the different papers were prepared for each examination and 

for the total These distributions are pre sented in Table 1] 
The average range of seores for the total ero 1}) ot papers Was 245 
but this was reduced to 12.3 by converting them to orades, The average 
for the algebra 


tion for the arithmetic papers was from 26.0 to 11.4 


rectue 


j 
bed 
ssigned 
Wee: 
> 
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TABLE II 
SiowrsG DISTRIRUTIONS OF RANGES OF ScorES AND RANGES OF GRADES FoR Fot 
SeTs OF EXAMINATION PAPERS 


Frequency 


Range \rithmet Algebra English Psychology Total 
Papers Papers Papers Papers Papers 
ur = S« Gr Se Gr Ss Gir 
i 2 
49.9 1 
4-449 5 
1.9 6 1 
4 4 3 17 
| 2 6 1 t 
1 l ‘ ’ 6 6 3 2 19 22 
10-14.9 $ 12 1 9 7 
0 l ] 2 4 1 4 8 4 26 
1.9 1 1 2 
Number i 24 2 2 2 2 20 20 o4 4 
Meat 26.0 114 27.2 13.5 21.2 13.6 24.3 10.0 25.5 12.3 


papers from 27.2 to 13.5, for the English papers from 21.2 to 13.6, and 
for the psychology papers from 28.5 to 10.0. For the total, for the arith 
metic papers, for the algebra papers, and for the psyehology papers the 
average range of scores was greater than the maximum range of grades 
found for any paper, and only one of the twenty-five English papers 


had a range of grades as great as the average range of scores. 

Although the table does not show it, changing the seores to grades re- 
dueed the range for every paper except one, an English paper where th: 
original range was very narrow (five points). It was also found that 
the amount of reduction (both relative and absolute) was more or less 
related to the size of the original range. That is, the conversion tended 
to reduce the large ranges more than the small ones. 

These maximum deviations are interesting but they tell but litle 
eoncerning the trend of the variations. They may well represent ex- 
treme cases of variability due to chanee factors where the tendency is 
for most of the marks to eluster closely about an average. To present 
a more complete pieture of the variations found, the probable error 

P.E.) of the scores and the probable error of the grades was calculated 
for each paper. Assuming a normal distribution, this measure, .6745 
standard deviations, may be roughly interpreted as follows: Given a 
particular P. E. for a paper the chanees are even that a given mark v ill 
lie within 1 P. E. above or below the true mark (the average of an infi- 
nite number of marks), the chances are 414 to 1 that it will he within 


® P. E.s of the true mark. the chances are 21 to 1 that it will lie within 


+ 
» 
r 
r 
' 
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} P. E.s of the true mark, the chances are 142 to 1 that it will lie witnin 
t P. E.s of the true mark, ete. 

As a result of converting the scores to grades the probable error for 
every paper was redueed and tor more than one-half of the papers the 
probable error of the grades was less than one-half as great as that of 
the seores. Further, the larger probable errors of seores tended to he 
reduced more (relatively and absolutely) than the small ones. 

Frequeney distributions cf the probable errors of seores, and of 
erades, for the separate papers of each set and for the total are pre 


sented in Table III. 
TABLE III 


SHowtnG DIstrisutTions oF P. E.s OF Scores anp P. E.S OF GRADES FO! 
‘foun SETS OF EXAMINATION PAPERS 


Freque 
Probable r 
Error Arithmetic Algebra Pseveholoegy Tota 
Papers Papers Papers Papers Paper 
Gr Sy Gr Gr Gr Gyr 
10.0-10.99 1 1 
9.0- 9.99 1 1 2 
2 0- 8.99 
7.0- 7.99 2 4 1 4 11 
5.0- 5.99 2 6 1 8 17 
4.0- 4.99 3 4 
7 4 5 7 5 19 
2.0- 2.99 4 6 15 | 4 
1.0 1.99 2 14 2 7 4 7 
0909 1 1 
Mean 4.3 19 1.8 2 +6 2.4 5.9 2.2 if 


The reduction following the conversion to grades is obvious from 
this table. For the total group of papers the average P. E. for the scores 
was 4.6; for the grades 2.2. For the arithmetic papers the average P. EF. 
of scores was 4.3; and of the grades 1.9; for the algebra papers the two 
averages were 4.8 and 2.3; for the English papers 3.6 and 2.4; for the 
psychology papers 5.9 and 2.2. The range of the probable errors of 
the grades was very narrow. For three of the examinations the average 
P. E. of scores was greater than the largest P. E. of grades found for 
any paper, and for the fourth, the English examination, only two of 


This measure of variability should not. he confused with the probable error of 
a score due to the unreliabilitu of the measurement which is commonly used with 
objective, particularly standardized, tests This latter measure is determined by 


correlating two’ forms of a test and includes beth the error due to subjectivity, if 


any, and the error due to the limited nature of the sampling. 
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had a probable error of vrades as lara us 

the most serious use made of the mark vivell on an eXamilha 


on is to determine whether the imdividual passes or fails, it seemed 
worth while to make a speetal study of the number of failures resulting 


from accepting the teachers” marks at face value compared with the num 


found when these marks were eonverted to grades. This comparisol 


Tol the 


he algebra, English, and chole gv examinations only 


Wiis 


Bolton, in his published report, did not inelude information on the num 


ber failed 1 the various readers; consequently, we have not been able 
to make the comparison for the arithmetic papers. 


In Table IV the variation from reader to reader in the number failed 


Thre riginal 


| marks are accepted is compared with the variations 


st marks are converted to grades This comparison 


IN 
or three of e examinations. In addition, the variation in num 
per | led narks are eonverted to grades 1s presented for the 


metic 


TABLE IV 
NUMBER F 
or Turee 


The striking fact found here is the decided reduction in the varia 


bility from teacher to teacher of number failed, resulting from convert 


ing the scores to grades When the original marks are accepted the 


number of failures range as follows: for the algebra examination from 

the English examination from 1 to 14, for the psychology 
examination from 1 to 11. When converted to grades these ranges are 
1 to 5, 0 to 4, 1 to 2, respectively. When grades are considered, we find 


one, two, or three failures given by twenty-two of the twenty-five readers 


the 
re 
fou 
ma 
; R AM 
Reach 
Grad Seor Girad Grade Score Grade 
f 1 
i 
! 
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- 
! 1 4 
\ 
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the algebra papers, twenty-three of the twenty-five reacers of th 


English pre rs and all ol thre readers ot the arithmetic papers Atte 


eonversion to Ss, SIX Ol the mine readers or The nsveholows papers 


conversion 


greed that onl one student should fail. and the hree other readers 
ich failed two 

Most investigators are convineed that the essay examination, as ord 
irily handled, is unsatisfactory as a measuring instrument. Does the 
teachers’ marks to by thre pPracess here outlined make 
them satisfactory? The answer to this question must of necessit) ” 
relative and seems to depend upon the degree of refinement required of 
the measurement. At hest. highly re fined measurement (to determine 


It is usually assumed 


vrades at least is not ck manded of the teach 
that if students ean be divided with a fair degree of aceuracy into fives 
groups (one failing and four passing the measurement is satistac 
for all practical purposes of erading. The data previously presented 
with reference to the probable error of the grades is an indication of 
their value as measures. The average P. E. found for the nintyv-fou 
papers was 2.2, which means that on the average if an infinite numbet 
of readers graded a paper the grades would practically wll lie within 


SS pomts foul ~P kE.s) of the average of seve ral markings Stated im 


anothe r wav. the range ol 17 points (il lowest erad given any papel 


the ighest 100 found in the erades used would meal 
the average paper would be rather consistently placed in a given on 
fitt oft the total range, and would therefore be consistently placed n 

five-letter grading system 

These statements are all more or less theoretical, assuming a normal 
distribution of marks and based upon the nature ot this distribution 
Che small number of readers used for the different examinations, pal 
ticularly the psychology examination, means that they ean be taken as 
nothing more than rough approximations. In order to show the actual 


misplacement found for these fou examinations we have made one Tul 


ther tabulation. Considering each grade on each paper separa he 
study IS eoneerned with 1954 evrades, vwivel by four different ‘ 
ers, We have attempted to show the amount ot misplacement that would 
result from accepting the respective readers’ grades by determining the 
number of grades that deviate given distances Trom the average grade 
civen a paper. Cumulative trequene) distributions, expressed in pet 
the papers of cae 


centages. of the deviations Trom the average grade tol 


examination and fo the total. are presented 
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TABLE V 

ving Cunt ep Freovency DIstristTIONS OF DEVIATIONS FROM 
Grape For Four Sers oF EXAMINATION PAPERS 


AVER 


Frequency 
\ ra Englisl Psycholog: Tota 


41 22.9 23.4 
445 


130 
Inspection of the table shows that 65.4 percent of the grades deviate 
two points or less from the average grade; 90 pereent of them deviat 
five points or less, and 99.8 percent lie within ten points of the average 
The differences among the examinations is not pronouneed. The psycho! 
ogy examination shows the least range, with arithmetie, algebra and 
English following in order. The narrow range of the psychology papers 
may be due to the homogenous nature of the readers used or it may be 
merely an indieation of unreliability because of the small number of 
readers. The other three examinations are arranged in the order in 
whieh one would expect them to fall; that is, one would expect, due 
to the nature of the subject matter, that the arithmetie examination 
would show the least variability and the English examination the most 
Assuming that deviations of five points or less are not serious, and thy 
forty to fifty points ineluded in the grading seale would in some meas 
ure justify such assumption, 90 percent of the students are placed aceu 
rately enough for all practical purposes. Deviations of ten points o1 
more are obviously serious, but such extreme deviations are very rar 

In summary, the conversion of these marks to grades by the techniqu: 
iserl here reduced the variability as follows: 

1. The range of the marks assigned the average paper was reduced 

more than one-half, from 25.5 to 12.5. 
>» The probable error of the marks assigned the average paper was 

» 


reduced more than one-half, from 4.6 to 2.2. 


A 
| —— 
ry 72.6 76.3 77.3 
1.2 917 9 
‘ on 92.6 973 94.2 
O5.5 96.1 100.0 96.9 
10 29.9 
11 1 90.9 ag a 
1° 100.0 1004 
ff 
1 
= 


33] REDUCING THE VARIABILITY OF EXAMINATION MARKS 647 


The range in the number failed was decidedly reduced: for the 
algebra examination from 14 to 4, for the English examination 
from 13 te 4, and for the psychology examination from 10 te 1. 
(This information was not available for the arithmetic examina 
tion.) 

4. Approximately 90 percent ot the grades deviate five points or 

less from the average of several teachers’ grades, and 2 negligibl 


pereentage (less than 1 percent) deviate nine points or mors 


It is impossible to say whether the grades on these essay CXaminations 
represent satisfactory measurement. Surely no one could contend that 
they are entirely unsatisfactory. Further, if we can assume that we 
have actually eliminated the constant errors due to differences in stand 
ards of grading, the variability of the grades would be decreased as the 
number of examinations was increased, and one could presumably (al 
though not necessarily practicably ) reduce it to a negligible factor. But. 
assuming an objective procedure for converting scores to grades, new 
type, objective examinations are not subject to this sort of error at all, 
and economy of testing would recommend their use. 

It seems to this writer that the case for or against the essay examina 
tion depends upon whether it measures abilities that are not (possibly 


one should say ‘‘eannot be’) measured by the objective examination. If 
it actually measures desirable outcomes of instruction that are not meas 
ured by the objective test, the evidence presented here seems to indicate 
that by converting the marks to grades it is possible to get fairly satis 
factory measurement with the essay examination. Certainly it seems safe 
to conclude that if essay examinations are to be used, and, in spite of 
agitation among testing experts for ‘‘ objective’? examinations, enormous 
numbers of them are still used, the teachers’ marks should be converted 


to grades. 
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rile RELATION OF PERSONALITY TO ACADEMIC APTITUDE 
\ND ACHIEVEMENT 


Ross 


ersilyu o 


wademie achievement is a problem whieh is still 


ving the attention of edueational investigators. Although intelli 
renee tests which consistently correlate 50 or better with grades, are now 
at prediction individual achievement are still 
e tnaecurate Two important reasons for the unsatistactory degre 
of relationship between aptitude and achievement may be suggested 
1) the defects of methods of grading; and (2) the energy output ot 
individual student, which probably varies independent of ability 
Industry and application will be determined not only by the student's 
interest in sehool work, but also by e rtain personal and emotional traits 
which intluence his activity level. It is the purpose ol the present papel 
to consider the relation of these traits of person ility to academie apt 
tude and achievement Data from both college and lower eduentional 


Jer s will be mentioned 


The primary difficulty in this problem is the measurement of the pet 


sonality. faeton \ptitude tests are of high reliability and ot presump 
tive validity Ciract s os eriteria of vement, are vive! and the in 
vestigautor must use them as they are. Tests for rsonalityv. traits, on 


the other hand, are often of low reliability and questionable validity (37 


n the foee of these difficulties. some relationship between grades, intelli 


rene these 


sures May appear trom a consideration of the 
niimerous sttidles wv hich have been made 
The appended bibliography is annotated with the chief results ot 


revious Investigations. It seems desirable, however, to summarize the 
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ty tor some of the more commonly used mensures of personality tralis 


neluel fol owing: miscellaneous ratings of personality 
Pressey N-O test measures of introversion-extraversion: measures of 
see the Downes Will Temper iment Test: various 


and the Moss social intelligence test 
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rating studies it 


With rerTereret To the results at 
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orades, the ratings corre late highl 


it however, open lo ill int 


facet that when pupils 


the teacher giving thet! 
ment: when the ratings are by ove unfamiliar wit! their seho 


the correlations ar low and as often negative as POSTTIVE Phe iM 
cients reported are often absurdly high (Ter Instanes Webb, (44). 21 
correlations ot 95 to betwecn eharacter traits and erades The 
eritieal use ot ratings OL al echaracteristies, is likely te 
to the eonelusion that these tralts are more closely 1 lated to grades 1} 
is intelligence, or ¢ mversely, that they are not hr lated at al It is p 
able that neither ot these eonelusions is correct 

Under certain circumstances the rating method can be used to ad 

| correlation of intelligence nal 


tag Laird (23) measured the 


s having some 


ment in groups selected a characteristic In common, ¢.7., 
students rated as industrious were compare i with those rated as indolent 
that personal traits may have a pronounced intlue 
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traits, one introverted, the other extraverted, on which the subject Is 
to be rated by himself or by another person. It is reported with corr 
lations of 21, .26 and OS with achievement (14,15). When age and 


intelligence are eliminated by the partial correlation technique, Hend 


rickson (15) reports a correlation for grade-school bovs of .46, wit! 


chievement kor girls, on the other hand, the correlation is only 04 

Laird’s inventory © 1 has been reported to correlate 35 with grades 
ls For the (2 revision. coefficients are re ported ot ae; 
24. 30 and .56 (5, 8, 13, 16). When extreme cases are studied, the in 


troverts are found to score higher on intelligence among college students. 
While in the lower grades extraverts usually score higher on aptitude 

lo. 17, 28, 45). The introverted college students are reliably higher in 
achievement than the extraverted group ; figures for vounger students 
disagree When the test seores are correlated with intelligence, th: 
coefficients approximate zero (5, 8, 13, 16, 18 

The Neymann-WKohlstedt, Freyd-Heidbreder and Conklin seales have 
net been employed in the study of this problem. 

The Downey Will-Temperament test attempts to measure traits of 
temperament and volition through studies of handwriting under various 
conditions, Its reliability and validity are low. Studies on its relation 
to achievement have usually been made on disparity groups,’’ i¢., stu- 
dents achieving more than their intelligence score would predict, as 
compared with students achieving less. Certain traits have been alleged 
to go with achievement beyond prediction, but the different studies dis 
agree as to which these traits are (9, 26, 30, 38, 43 

The Allport A-S test measures aggressiveness or self-confidence in 
face-to-face social situations. It consists of described situations in which 
the subject is to indicate his probable response. Correlations of .06 and 
04 are reported for grades. When extreme eases are studied, one report 
indicates the superiority of ascendants, the other of submissives (3, 4 
Plotting grades against aptitude and ascendance, Broom (4) finds that 
in proportion to intelligence, dominant students make better grades than 
these who are submissive. 

Beginning with the Woodworth Personal Data Sheet, many ques- 
tionnaires have been devised to discover the relative freque nev of pSvV- 
choneurotie traits in college students. Laird’s B1 and B2 inventories 
employ graphic self-rating seales. Thurstone and Thurstone’s Per- 
sonality Schedule includes 225 questions, to be answered by ‘‘ ves,’’ ‘no,’ 
and ** ?°* (doubtful Payne's inferiority seale (14) ineluded fifty state- 


ments which the subject marked as true or false relating to himself. 
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Correlations with grades are O35 tor the Woodworth P.D sheet, 4 and 
10 for the Thurstone, 04 for the Payne seale, 0 for B1 and .11 and 


10 for B2 (11, 12, 14, 18, 99 93. 25, 38, 40, 45). Correlations with 
intelligence are similarly vers low (on the whole it 1s indieated that 
neurotic students achieve slightly higher marks than stable individuals 


This may be due to the lack ot social interests In the rit urotie 


The Moss Social Intelligence test shows surprisingly high corre lations 


with grades. Unfortunately, it correlates even more highly with intelh 
gence, and adds little or nothing to the multiple correlation with grades 
correlations of .49, 47, .42, .36, 29) (20, 56 

As a sort of summary of this survey of the literature, the following 
points may be stated : 

(1) Objective measures 0! personality show no linear relationship 
to either academie aptitude or academic achievement. 

(2) There is evidence that unstable, maladjusted students do less 
well in proportion to their intelligence than do those well-balanced, and 
that there is a closer correlation of capacity and achievement in stable 
groups. 

(2) Introverts appear to earn proportionately higher marks than 
extraverts, in a college population 

(4) Dominance alse appears To he a factor influencing grades in two 


groups of equal intelligence. 


EXPERIMENTAL DATA 


We have made efforts to study this problem further with the use of 


various objective tests ot personality : the Pre sse\ X-0 test form A 


some studies of which have already been me ntioned; the ABC question 
naire. a test of emotional stability developed by the author, which has 
not been standardized; Allport A-S Reaction Study: Laird (2 inven 
torv; Ney mann-Kohlstedt test for introversion extraversion ; Thurston 


neurotie inventory ; Moss Social Intelligence test; and the Bernreute! 


Personality Inventory. The available data on the relationship of thes 


tests to academic aptitud d acl levement have heen revi wed \Ios 


est. a recent development whiel 


of our data deal with the Bernreute! 


gives scores tor self-sufficiency, introversion, ane dominanet 
present 
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on the American 
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. about 12 cases, hence they ean only he considered as confirmatory 
the indieations given in the larger and more heterogeneous group. 
e° In addition to a study of the direet relation of personality scores 1 
e aptitude and achievement, it was necessary to find the influcnee of per 
bee's sonality upon the aptitude-achievement correlation. The results ar: 
shown in Table ITI 
; It appears from this table that low neurosis, high self-sufficieney and 
rABLE III 
; ACHIEVEMENT-INTELLIGENCE CORRELATION WITHIN EXTREME 
PERSONALITY Groups 
r 
High Neurosi 
w Neur 
Hich S su flicic 
Low Self 7 
Hich Dominance 71 
Low Dominance 44 
Entire grouy n l 
aga TABLE I\ 
PERSONALITY SCORES OF ‘* ACHIEVERS’’ AND NonN-ACHIEVERS’’ 
Meat Diff C_R 
\ $13.4 63.0 
Non-A's 835.4 82.44 15.18 1.44 
\'s 898.2 42 
Nor \ 5 47.4 - J 1 
é ane 925.2 0.74 
Non-A’s ols 4 59.42 6.8 11.47 0.59 
high dominance are conducive of achievement closely proportional to 
intelligence, while the contrasted traits are likely to lead to achievement 
either above or below the prediction from ability. This is what we should 
. expeet especially from neurotic students, who are likely either to rush 
into academie work as an eseape from social reality, or rush away from 
school activities beeause of conflicts associated therewith. 

It Was also thought possible that students achieving more than would 
bye per dicted from their aptitude score would show differences in person 
ality from those achieving less (comparison of ‘‘achievers’’ and ‘‘non 

achievers This was done by taking the seatter-diagram for the apti 
Brame tude-achievement correlation and marking off cases in the upper right 
hand and lower left-hand corners away from the ‘‘line of best fit.’’ Pe 
sonality scores were then computed for these groups. The differences 

found are shown in lable IV. 

It appears trom this table that achievers are characterized by a low 
emotionality score and a low self-sufficiency score. The differences ar 

es. large enough to be considered important, if not completely reliable 
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GENERAL CONCLUSIONS 


From the previous studies which we have reviewed, and from t! 
tu just presented, it becomes Increasingly clear that personality in 
( fluences achievement in an indirect way, by affecting the degree to whic! 

se is made of the individual’s potentialities. This fact explains th 
initormls low linear correlations found. At some points along the dis 
tribution personality is an advantage in academic work while different 
mounts of the same personality variable may be disadvantageous, o1 
may be operative in one direction in one case, the opposite in a similar 
situation 

It is also clear that personality measures can never be used as en 
trance qualifications, because the students seoring high on undesirable 
traits are also high on aptitude, and represent the very stratum we shoul 
be developing rather than discouraging. 

The data are considered an important argument for improved coun 
seling systems in our colleges. It becomes more and more apparent that 
students of great promise are being allowed to go to wreck upon the 
reefs of personality maladjustment when a successful adaptation might 
be relatively simple with adequate guidance. The author's own experi 
ence with personal interviews of these students is convineingly im favor 
ot the belief that a few hours of good advice and sympathetic listening 
to troubles will change the course of their university lives decidedly for 
the better. 

SUMMARY 

1. Linear correlations of intelligence, achievement and personality 
measures are low and are probably so as a result of the inherent nature 
of the relationship. 

2. Extreme personality trends seem to counterbalance advantages In 
aptitude, making for equal achievement in opposed groups. High emo 
tionality and high self-sufficiency lead to lower achievement that would 
he predicted from intelligence scores. 

3. Personality factors have marked influence on the correlation of 
aptitude and achievement. 

4. Arguments are presented for the use of these measures In im 


proved counseling systems. 
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Students.”’ Journal of Educational Psycholoqgu. XIV ] 

209-14. 

Rated *‘scholarship qualities,’’ (1) .93, (2) .85; “‘eitizenship quali 
ties,’’ (1) .92, (2) .77. 

Stone, (. Disparity Between Intelligence and Scholarship,” 
Journal of Educational Psi holoqy, NIII 1922 pp. 241 $4 
Disparity group (grade and intelligence ranks differ by 50 percent 
speed of writing and (1) .60, (2) .12; association frequency with 
(1) .00, (2) .18. Normal group (ranks differ by 2 percent), speed 
of writing with (1) .09, (2) .03; association frequeney with (1 
.63, (2) .64. 

Strang, Ruth. Relation of Social Intelligence to Certain Other 
Factors.’’ School and Society, XXNII 1930). pp. 268-72. 

(1) .29. (2) 44. “*Test 2’’ with (1), .15. 

Symonds, P. M. Diagnosing Pe rsonality and Conduc Ne WwW York 
Century Company, 1952. 

Thurstone, L. L.. and Thurstone, T. G. ‘*A Neurotic Inventory,’ 
Journal of Social Psy hology, | 1930). pp. 3 30) 

(2) .04. Neuroties, slightly higher grades. 

Traxler, A. E. ‘*Will-Temperament of Upper-Grade and Hie! 
School Pupils.’’ School Review, (1925), pp. 264-75 

(1) .138, (2) 35, (3) 4. Analyze individual profiles for causes o 
disparity 

Turney, A. Factors Other than Intelligence which Affect Su 
cess in High School, (Minneapolis: Minnesota University Press 
1930), pp. 1-155. 

Achievers vrades above intelligence rank . compared with nor 
achievers below ). A’s higher on ratines, but not differentiated 
by tests of intreversion, inferiority altitude. 

Turney, A. H. ‘Intelligence, Motivation and Achievement.” Jo 
nal of Educational Psychology, XXAUL (1931), pp. 426-54 

The two major tactors In school achievement are intelligence anc 
motivation. 

Tyler, un. T Bearing of Certain Personality Factors Other than 
Intelligence on Academic Success, Contributions to Edueation, Ne 
468. New York: Bureau of Publications, Teacher's College, Co 
lumbia University, 1931. 

New rating seale. <All correlations with grades low. unrehable 
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\\ York renu of Publications. Teachers (‘olleve olumbi: 
niversity, 1928), pp. 1-78 
Speed of writing 28: freedom trom load, 23 


$4 Webl Kadward haracte. Intelligence,” British Journal at 


tatinws: endeney to do kindnesses on principle,’ (1) 


1H. Young, J. B Hlow Emotional Traits Predispose to College Fail 
anal of ka ‘4 thional Psi holoagu. X Vili 1927 6:5 


7 ests ( 2 and B 2.) More failures in the extraverted-stable group 
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WHAT DO THE MEIER-SEASHORE AND THE M ADORY ART 
TESTS MEASURE’ 


HERBER A. ‘ 
i situ of M ali 
A short time before this investigation Was undertaken, the wrl 
earned the Mie er-sSeashol 


found that the eorrelation hetween scores 
the MeAdory Art rest was 


Art Judgment Test and seores earned mm 
put 27 OO, a barely reliable relationship Eevict ntlv the two tests «a 


measure the same kind of art ability 


The 
lt was thought that some light might be thrown upon the question: as 
To precisely what each did measure comparing results with 
tors’ judgements Following up this possibility, the writet asked the 
membre rs of the staff ot the-art education departme nt of the Co 


seven 
lege of Edueation, University 0! Minnesota, to arrange In rank ordetl 
105 students who were majorme int These iistructors were «l 
to base their ratings on the comparative ereative ahilities of the students 


Since each instructor Was not thoroughly familiar with the abilities 
of the one hundred or so art majors it became necessary To make some 
classification ol the basis on which the Opinions were vlvel The follow 

tan 2) doubtful 


ine was finally decided upon: (1) comparative certal 
ranks were arrived 


(3) guess. From the scores givel composits 

for those who received comparatively certain and doubtful ratings, ate 
tor those who were rr presented in all three eolumns A table was ther 
drawn up showing the percentile ranks 01 each student aecerding to | 

instructors’ judgment, his success with the MeAdory test. a) d his sue 
with the Meier-Seashore test. See Table | Instructors judg 


were classified as compara 


1h this table include only those while 
The twenty students whose records 
103. the only limitation being that 


ments 
tively eertain. are present (| were 
ehosen at random trom the total ot 
heen well enough known to have 


is Instructors Since the m 


each must have received a compara 
tively eertain”’ rating by at least Tour h 
tetors numbered seven, Tour constituted a majority 


stru 
An examination of the 
1 disagreement among thre 


comparative pere ntile ranks reveals immedi 


ately the marke« three measures. For exampl 


The writer 1s leeply indebted to the Committes n Edueational Res 
University of Minnesota, Tot initiating and supporting series studies 1 
tion of which this 1s one, Professor Ruth Ray1 ond. head of the art ea t 


educa 
department, also rendered valuable assistance 
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TABLE I 


\ RISON OF PERCENTILE RANKS OF COLLEGE ART STUDENTS ON ART 
JUDGMES TESTS WITH RATINGS GIVEN BY ART INSTRUCTORS 
Ah Instructors 
Me Meier-Seashore 
STUDENTS PI \rt Art Test 
N N tating PR PR 
‘ 
i 17 13 14 
-4 4 40 
28 27 7 
‘ f ‘ 64 17 
’ 48 
‘ 42 
$2 77 
4 
7 95 S4 ‘ 
7 “4 70 
‘ 61 a7 
64 
is ‘ 78 
4 72 
number 11 earned a percentile rank of ninety-four from her instructors, 
af but fell to a percentile rank of five on the MeAdory Test. On the other 
1 hand, in the ease of number 15, there is striking agreement 
The resulting correlations appear in Table II. They are not marked, 
but the Meier-Seashore consistently correlates higher with instructors’ 
judgements than does the MeAdory. 
TABLE Il 
CORRELATIONS BeTWeen Art Instructors’ RATINGS AND Scores ON ART TESTS 
N Pt 
i at terta Ra zs 
‘ h M Seas! \ lest 29 7 
MeAdory Art 7 7 
ura vy ta Rating 
Meier-Seashore Art 17 77 ‘ 7 
Me Ade rt est 
1 \ Rating 
} \ er-Seashore 2 6 
MeA Art Test 07 
a EFFECT OF TRAINING UPON ART ABILITY 


The writer approached the problem of the effect of training upon 
art ability in four different ways: (1) through a comparison of the art 


=| ability of a group of junior high-school students without art training 


a] 
= 
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with a group of senior high school students with art training: (2 


through a comparison of the art ability of these senior high-school stu 
dents with that of college students; (3) through a comparison of the 
art ability of college groups classified on the basis of the amount of art 
education; and (4) through an examination of the amount of improve 
ment made over a one-vear period by art majors and by non-art students 

Table II] presents the data resulting trom the first method of ap 
proach. The difference of twelve points in favor of the senior high-school 


TABLE III 


4 COMPARISON OF TITE ART JCDGWENT ABrurty oF Sextror StTrpexts 


witH ART TRAINING AND JUNIOR HIGH-ScHooL STUDENTS WiTHouT ART TRAINING 
N CA MeAdor Art S ‘ 
Boys Girls Tota Range tange Mea 
High 
Sel Art 
lents 1 2 14-11 17.14 151 322 l ri 
20-9 214 
Higl 
School Stu 
ents 1 2 11-¢ 74 104 
l 194 
Difference 79 
P 17 


art students is not great when it is eonsidered that thes are approxi 
mately four vears older, and that during these four years they had been 
studving art rather intensively. The junior high-school students, on 
the other hand, had had no training in art except the little that is ordi 
narily given in the grades in large city school systems. Whatever it ts 
that the MeAdory test measures does not seem to be reliably improved 
by several vears of training on the high-school level. 

When, however, these senior high-school students are compared wit! 
art majors in college, a reliable difference in art ability is found to exist 
although there is considerable question as to whether or not this differ 
ence is the result of art training. It may well be that only the abler art 
students go on to college, or that increase in chronological age accounts 
for the inerease in art judgment ability. 

When, on the college level, students who have had a great deal of 
art training are compared with those of little art training, the difference 
is negligible, a finding whieh indicates the conelusion either that train 
ing has little effect upon critical ability in art, or that the tests used do 
not sample materials ordinarily taught in art classes. (See Table TV 


There is, however, a reliable difference between the seores of those who 
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art training and those who have had Th dat 
revea vhether this is due to the training or to a leck of innate 
on the part of those with no training 
most sutistactol method of measuring the effect of art training 
it ¢ art hivment ability measured TeSTS IS obvioush 
the winning and at the end org period of mstruction Tl IS 
ter did with lov college students The Meier-Seashore as 


vy iustrument The results appear in Table V. and are the most 
tof anv that appear in this discussion. Both the art majors 
TABLE \ 

ix 

rt stuck his snow a gain over a riod or aie vear, The 
mwevel lor the non-art struck nts ISN tow small to be re liable For 


majors, It is o> pomts, a very small amount when it is remembered 


vyroup has been subjected during the interval to intensive in 


min the prineiples of art. The residual gain of art majors over 


students is 1.58 1.03 


first part of this Investigation brought to the surface two definite 
that neither tie ashore Art Judgement Test nol the 
\ Art Test correlates to any considerable extent with the judg- 


iniversity art instructors relative to the creative ability oft art 


in college: and (2) that the Meier-Seashore Test agrees with the 


TABLE I\ 
| 
\ 
nel tl 
the 
it 
Me Ado 


WHAT DO ART TESTS RASU HI 
nstructors somewhat more than dloes the Me Ador the correlation to 
e Meiler-Seashore and instructors” rating 40 OG and for th 
MeAdory and mstructors rating. 
As a result ot the second approach made m this studs t was found 
tha training In art appears to inthuence an art test seore but shehth 
Whether this is because art tests measure an mnate talent rather that 
earned reaction, ol because thes do tot measure what s ordi 
wht in art courses Is hot known. 
The writer realizes, as I eoneludes this paper, that the Mm 1 im 
resslon Upon the readel will be badly blurred The main cause ol this 


whether it be art, Dterature 


s the tact that mn the field of appreciation, 
music. the investigato! has but little te guide on aid him. Measuring 
objective data Tew valid and 


nsiruments are Inadequate 
problems in the psvehe 


llv nothing Is 


liable tests have been constructed, inmumerable 
Ol aestheties ean be solved For example, pracy 
known objectively of the relationship hetween creative ability ane 


ability to apprectat thie relative effect ot erect, environine 


ot race. Ot Sex, Ol ot factual information upon sesthetl 
of the supposed emotional instability ot the artistic genius; of the acti 
value of the kind of tramimeg in’ art and in the other appreelations that 
« being given In American schools. The door staneas wide open to th 
research worker who Is ¢l allenged and faseimated by the ilties 


volved in a scientifie study of sue! bole riables 


‘or 
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A COMPARISON OF SCORES ON TWO COLLEGE FRESHMA’ 
INTELLIGENCE TESTS 
LILIAN HUNSICKE! 
Vilwaukee, Wisconsir 
Tue dearth of understanding and the patent misunderstanding o 
standardized test scores displayed by educators constitute a serious handi 
cap to progress in the scientific study of edueation. The condition is 
confined to no one level of teaching; it seems to be universal. College and 
university faculties surpass, perhaps, the lower schools in furnishing ; 
full quota of edueators who show gross ignorance of the elementary tenets 
of setentttie measnrement. The imterpretation of achievement test scores 
on the basis of one hundred representing the perfect mark, and a collew 
student's score on an intelligence test as his 1Q are typical of the erud 
fallacies that are far more prevalent than may seem credible to th 
cloistered laboratory investigator. 
The study herein reported was undertaken in the hope that it would 
be helpful in seattering the fog that so frequently envelops a comparison 
of two scores of different numerical value, both made by the same subject 


on different tests of the sume trait. 


REPORT OF THE STUDY 
The Tests Used: 

1. Thurstone Psychological Examination, 1929 Edition; administered 
in the University of Wisconsin state-wide mental survey of high 
school seniors. January, 1930 

2. Thorndike Intelligence Examination for High-School Graduates 

forms S-L-O, series of 1925-30; administered for the regulan 

freshman intelligence test in the State Teachers College, Mil 

waukee, W iseonsin, October 1. 1930 

Subjeets Who Furnished the sSeores : 

Those first semester freshmen in the Milwaukee State Teachers College 

the fall of 1930 for whom there was available a seore on each ot 


the two intelligence tests. 


TABLE I 
SUMMARY OF THE ANALYSIS OF THE TWo DISTRIBUTIONS OF ScoRES 


Distribution 


Scores N Range Mean Sigma 
On Test 1 22 45 to 262 145 48 
On Test 2 22 17 to 95 7. | 15 
r 82, P.E. + .01 


666 


FRESHMAN INTELLIGENCE TESTS 


TABLE Il 


Eat ATING OF THE SCORES ¢ HE rwo TESTS 
Scores 
Test 1 Test 2 Test 1 
12 l4 1 17 141 14 l4 7 
16 17 18 18 144 145 146 
19 23 19 147 145 
27 21 l 154 61 
25 if 16 162 ‘ 
J4 it 164 16 
41 4c 43 171 Ht 
i4 46 47 2% 17 174 17 t 
4 176 177 178 Hs 
1 179 1st 181 60 
4 6 is Is 
47 1 1s 183 7 
‘ 61 62 188 é 
65 66 102 10 104 
67 6s 6u 4 10 197 4 
7 71 72 ; 198 199 
7 74 ¢ 201 02 2 7¢ 
76 77 79 7 4 OOS 206 207 
a6 a7 214 21 216 
41 217 218 219 
3 a4 ) 42 2 222 23 
9 10% 44 27 29 
102 104 4° 231 
107 at 234 se 
108 109 11 111 i7 237 ts 249 
112 113 114 4 241 
115 116 117 40 244 
118 119 ~46 247 248 
121 122 12 1 -49 251 251 
125 126 127 254 
121 132 13 4 "59 6 61 4 
144 135 136 264 
137 138 139 f 


By reference to Table II, it is possible to compare, for this group o! 
students, the score on one test with the equated seore for the other test 
For example : A seore ol 25 on Test 1, reading across, corresponds to a 
score of 21 on Test 2; a score of 79 on Test 2, reading backward, corre 
sponds to a score of 213. 212 or 211 on Test 1. 

This table has preven helpful, and other tables compiled from similal 
data. should be useful in the effort to make meaningful to students and 
instructors a sound interpretation of standardized test scores that differ 
in numerical value but are trustworthy measures of one and the sam 


trait. 
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DO THE STANFORD-BINET 1Q’S OF SUPERIOR BOYS AND 
GIRLS TEND TO DECREASE OR INCREASE WITH AGE? 


PSYCHE CATTELI 


ONE of the important questions tor those who administe r intelligene 
the results in school, clinic, or institution is the question 
CONSTANEN of the intelligence quotients Kar \ 


line the relative 
there is a fair degree 0 


nvestigations imdicated that. on the average, 
but that some large changes do oc ur Later studies have 


fact that there is probably a relationship between intel] 


brought out thre 
and CONSTANE 
place with age in the IQ of children of 


le vel The present r Is concerned with thre 
SUperio: 


chanae hieh take 


ntelligence 

In the third volume of Genetic Studi, s of Genius, Professor Termar 
and his colleagues report the results of retesting eighty-four children who 
had an initial Stanford-Binet IQ of 140 or higher. The authors found 
hat during the six vears between the two tests these children, as a group 
tin TQ. The loss of the boys was only three points, which may not 
have been signtifieant but the loss of the virls Was thirteen points This 
hook came into the hands of the writer s] ortiy after the completion of 
tudy in which the results indieated a tendenev for the superior ehild 
to Tnerease in as he advanees in wing to the contradietor 
conelusions of the two studies, it appeared worthwhile to make a furthe 


tnalvsis of the ivard (irowth Study data. especially ot the small 
. 


all 


fF eases with IQ's of 120 or higher. 

(on Vv the records ol the children who had heen given at least TWo 
Stanford-Binet tests with a time interval of five or more vears between th 
first and the last were considered, unless othe rwise stated. The cases 


were c¢iassified by sex and then into 10 pont I groups according to the 
corrected” Stanford-Binet IQ and the medians 


average ot t he several * 
of the differences between the first and last test caleulated for each group 


In order to avoid the complicating factor of practice no test was con- 


sidered unless more than a year had elapsed between it and the preceding 


test 
The 1Q’s of those children who passed a total of five or more tests in the 16 and 
IS vear levels were ‘*correeted’’ by the method reeemmended by Professor Terman 
nh pug t Studies of Vol l 
bos 


4 4 
Jlarvard University 
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STANFORD-BINI T 10°S8 
‘n Table I and Figure 1. In the two lowest 1Q 


The results are given 
about 


Oss hetween the first and | 
1 girls being almost identica In the 


the boys gained one point while the girls lost two. In ll thre 
higher 


90 1Q group, both boys and girls gained 


groups the | ast examination Was 


pomts, the loss ot the boys am 


yroup 


vroups above the 
the bovs, howevel it each 


the IQ) level the greater the gam, 
of the girls, the eroul 


made a gain which was almost twice that 
120 and above the boys mace 
The probable error Is Sv large 

ittie signifieahes 


eases, that the median would he of lit 


ol a median gain ol twelve ports ana 
virls ot seven for this group, owing 


the small number ot 
for the general trend ot 


too eornsistent 


if it were hoi the curves whieh ts 


to be jonored 

One of the nine boys in the highest IQ group lost four pots; the 
others gained from seven to twenty-four points each, Ol the elevel 
girls, two lost, one four pots and the other six point .: the remaining 
nine gained frem two to thirty-four pomts each. These results are 1 
marked contrast to those of Protessor Terman and his colleagues who 


write: 
“The tabulation trom which Table 7 was derived shows that 
: 8 of the total 38 boys lost as much as 15 points each m 1) 
. er 7 of the total of 38 bovs gained as much as 15 pomts each 
. lool the entire 34 girls lost as much as pomts 
only one ol the entire 54 gained as much as 1) points eacl Phere 
, were several cases of extreme change. two. . . boys and fou 


girls each drop] ing 25 points or more 
In the material trom the Harvard Growth Study, four of the nine 


ven girls gamed as much as fifteen pomts m lq 


hovs and three ot the ele 
None of either sex lost as much 
girl mace extreme gatits o} 


as fifteen pots, the great 


six points. Two boys and one 


more 1Q points. 


TABLE I 
MepIAN CHANGE IS IQ APTEI Five or More YEARS 
Boy G 
1Q Lev N Me M 
Below *& i 2 
aa 4.7 4 
or ao 10 6 5 
1 109 4 l 7 
11 119 + 6.2 1.4 4 
120 and al +12 l 
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Six of the bovs and six of the girls with average 


heen third Stanford-Binet examinati 


had 


atter 


viven a 


the first test and two vears before the last 


number of cases is too small to bear much weight 


to 


that in both the hows and wit 
For 


however, note 


middle IQ fell between the first and last IQ. 


ihe H | Vol. Vo. 
of 120 or higher 


on at least two years 

Unfortunately, the 
It may be of interest 
Is the th 


the girls the averages 


iverage of 


from first to last were 119, 125 and 132, respectively, and for the boys 


119, 135. and 136 respectivels 


+ 


1a Cha 


60-79 8089 9099 10119 /20+ 
IQ Level 
KI I MepIAN IQ CHANGES AFTER 5 OR More YEARS 


There were differences in the selection and tre 


atment of data which 


probably account, at least in part, tor the almost diametrically opposite 


findings of the two studies 


Harvard study as in the Stanford study. 


EF raminers:—Several times as many exami 


The 


ners took part in the 
ill corps of examiners 


in the Stanford study, probably made for more uniform testing condi 


be maintained in the Harvard 


is than eould 


study, but the larger 
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number of examimers has, at least, one advantage. It has served to 
eliminate the possibility ot the results being modified through a constant 


error cause | hy ine py sonal bias of one or two examiners It is. however, 


almost cert lin that such a persona bias, had it been present in the Stan 


ford study, wou | have been detected Evers test was scored twice Tron 


verbatim responses 
2 Time Interval:—The time interval between the two tests In the 


present 


Stanford study was approximately six years In all eases; in 
study the average interval was also sIX Years, but the range Was trom 


i0 to 91 months 
3 §Practice -—There is no indieation in the Stanford report that the 
children were given more than two tests; 1p the Harvard study nearly 


half of the ‘very superior’’ grow had been given or more examina 
tions The possibility may oveur to the reade that the pupils of the 
present study may have profited from trequent applications of the tests 
and thus raised their iater It) 's A recent studs vave evidence that the 


effects ot practice on the Stanford-Binet examination does not earr 


over six months.” No ease was included in this study in which there had 
not been a vear between the last test and uny previous test Additiona! 
evidence on this was obtained irom the records of torts three 


dren ot similar age and It) level who had re peated thre Stunford-Binet 


examination atter a period ot trom seven to clehteen months lt 


nerease In It) reported above had been due to the effeets of practice 


still larger increase should be present in this group where Ti tests wer 


viven nearer together, but it was found to be only one pornt 


} The Staniord cases were sé lected on the basis of the I() 0 140) 
or hiahe ron he initial Test The enses i th yresent study were Sf ected 
from the Harvard Growth Study material on the basis of a mean ** col 


rected It) ot 10 or higher from two or more TeStTS one ol the 


Harvard obtained an averade 1Q us high as 140) there nad 


heen a higher group it is, of course, possible that a drop would have 
heen found. but the trend of the curves 0 dieate otherwise 


=. Nelection of Cases: A eertain amount ol lowering ol the 


authors indicate three or four points would he expected irom statistical 
regression in a group of superiol children who were selected from then 
initial 1Q as was the Stanford group. This tactor, it is believed, was 


avoided in the Harvard study by giving equal weight to the and 


first 


Cattell. P. ‘*Constant Changes in tl 
tional Psucholoay, October, 19 
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last test in the 1Q classification. A further study of the Growth stud) 


lata indicates that the method of selecting cases in the Stanford stud) 


may have eaused a greater drop in the second IQ than was suspected 


\mong the Growth study pupils who had had at least two Stanford-Binet 


examinations with an interval of three or more years between the first 
nd last examinations there were eighty-five cases who had an averag 
IQ of 120 o1 higher while there were only sixty-seven who entered th 
study with an 1Q of 120 or above. The median of the differences betwee 
the first and last examination of the eighty-five cases with an average IQ 
of 120 or higher was +6.4, while the median of the differences between 
the first and last test of the SIXEV-Sé ven cases with initial IQ) 's of 120 o1 


higher was 0.2. If this sample is comparable with the Stanford group 


would aeeount for 6.6 of the nine point drop found in the Stanford 
study, but since the Stanford group was a much more highly selected 
yroup and the time interval between the tests longer it appears possible 
that a spurious drop, greater than 6.6 points, may be present in the 
Stanford group. According to the formula given by Professor Kelley,’ 
statistieal regression would not account for more than about one half ot 
the 6.6 points difference. But the fact remains that when a group of 
superior children was selected from the same material Dy each of thi 
two methods this difference in gain was found to be present. It appears 
possible that whatever the factor, or factors, operating as the cause in the 
Harvard study may also have been operating in the Stanford study 

6. Age:—It appears possible that the difference in the ages of the 
two groups mas have been a contributing cause ot the different results 
found in the two studies. The children with 1Q’s of 120 and above, whose 


records were taken from the Harvard Growth Study mat rial, averaged 


about one vear olde than those included in the Stanford study, her 


were closer to their adult mental level. The Stanford group varied im age 


from 2-0 to 6-0 vears at the time ot the first testing and from 5-0 to 13-0 
Int } etation of Ed cational Measurements. New York: World 


\ further study of the trend of the IQ of gifted children is planned at he 


Pevehbo-Edueational Clinie of Harvard University In collecting data Dr. E. A 


Lineoln has reeently retested about SIXT children who obtained Stanford-Binet I 2 
f 120 of igher at the time thev entered the first grade or kindergarten five to eight 
venrs ag These ildren as a group lest 5.1 1Q pommts. Those that had an initial 
IQ of 130 or higher lost 4 points, but those that had an average of 130 or higher 

e two tests. gained 7.5. The cases are as vet Tew in number, there being only 
twelve ises with an imitial IQ of 130 or higher and seventeen who averaged as high, 
hut insofar as thev go thev eorroborate the Growth Study Findings. 
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vears at the second: the range in tne Harvard data was from 5-11 to 


7-3 and 12-2 to 13-10 respectively A number of the Stanford group 


were Ol pre-scheol age when first tested, while all ot the Growth studs 


some psychologists believe that the Stanford-Binet 


pupils were in school 
than the \ 


test standards are relatively lower at the bottom of the scale 
are higher up. If this were true 1 might aceount for some of the loss 
in IQ of Protessor Terman's group. 

Irregularities in the upper end of the seale might cause similar 


results. We have no Stanford-Binet data trom pre school ehildren, but 
data obtained from children in the grades indicate that the selection 01 


eases on which the test was originally standardized was a remarkably 


fortunate one. The number ot cases is too few to make a reliable stud 
of age, but, if anything, the older children in the Stanford study have lost 


more than the vounger children. 


SUMMARY AND CONCI USIONS 


1. Two studies ot gifted children, one made at Stanford University 


and the other at Harvard University, obtained contheting results The 
la decrease, with age, in IQ ot the superio! 


Stanford findings point towar 
ly data point toward an merease 


child, while the Harvard Growth Stuc 
2 The two factors which appear 
the method of selecting the cases, and 


To he the most probable enause ol 


the conflicting results are: (a 

b) the difference in the ages of the two groups. 

° The Harvard Growth Study corroborates t! 
the tre nad ot the IQ's ot 


it 


iat of the Stanford in 


regard to the direction of the sex difference m 
superior children. The Stanford data show a greate! decrease In 
IQ's of the girls than in those o 


smaller gain among the girls than 


f the ho s. while the Harvat 1 data show 


among the bovs 
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rwo EXPERIMENTS IN LEARNING EDUCATIONAL 
STATISTICS 
DEN? H. CooKkt 
Georae Peabody Colleae Te ache 
PIRST EXPERIMEN’ 

Do students obtain most from courses in educational statisties by 
spending all of their time in working problems, in reading statistical 
textbooks and literature. or in a combination of both of thes procedures 
In order to secure information on this question the writer conducted his 
course in educational statisties last veal in an rimental manner. Th 
eighteen students in the elass, all of whom were graduate students, were 


divided into three groups having equal average int lligenee as measured 


on two group intelligence tests | pon entering the class only three ot thi 
students had ans knowledge of edueational statistics One of these stu 
dents was placed in each of the three vroups. 

Each student in the reading group was to read two hours daily from 


a ocure rally prepared reading list, and prepare a port showing the time 


ame the TOples covered Kach student In the proble ms group Was To 
spend two hours each day working statistical problems. This work was 
handed in each day Each member in the combination group Was to 
spend one hour daily reading and one hour in working problems. A 


check on the amount of time spent on the assignments indicated that each 
vroup spent an average of two hours and two minutes daily. 

rhe experiment was conducted according to this plan for six weeks 
during which time three true-false tests were given. At the end of this 
period two objective-type achievement tests in educational statistics (pre- 
pared by the author) were given, namely, R; (a test of interpretations 
and P, (a test of processes. For the second six-weeks of the experiment 


the reading and problems groups were interchanged, the combination 


vroup remaining the same. During this period two true-false tests were 


yiven, answers to which were to be vivel hoth in and out ot class (giving 
two sets of results). This made a total of seven true-false tests during the 
experiment At the end ot the second six weeks per iod tests R and P 


separate torms of the test on interpretations and the test on processes, 
respectively) were given 

The authors of the two intelligence tests used to obtain equivalent 
groups claim a rather substantial reliability for the respective tests 
Fifteen of the twenty-one intercorrelations computed for all of the 


combinations of the scores on the seven true-false tests, are sta- 


possible 
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tistieally significant, indicating a certam degree of reliability for the 
seven tests. The twenty-one r’s ranged in size from .27 to .77 The. 
hetween forms I and II of the achievement test (R), given at the dot 
each six-weeks period, Is .8S 04. The vr between forms I and II ot 
the achievement test P given at the end of each six-weeks period, Is 
92 + 02. These r’s indicate a fairly substantial reliability 
RELATIVE ACHIEVEMENT Ot rHE THREE GROUPS 
It mav be observed from Table I that the combination group slightly 
exceeded the r ading group on each of the seven true false tests The 
combination vroup scored highe r than the probl ms group in tour he 
seven tests, and scored equally with the problems group on one test Tie 
problems grouy ¢ xceeded the combination group on Two tests The read 
ing group scored higher than the problems group in three ot the seven 
tests, while the problems group exceeded the reading group in tour tests 


In the main, neither the reading nor the 


S d correctly, 


other in the number of true-false statement 


scoring an average of 504 statements. 


mis group exceeded the 
each oral 


The combination group, howeve) 


scored a slight advantage over hoth the problems and reading groups, 
answering an average of 31S statements correctly. | ertainly this differ 
ence of fourteen statements Is not statist eally reliable probably due to 
the small number of cases involved), but there ts a slight tenes for the 
combination group to exceed both the reading and the problem: group 
rABLE I 
MEANS 0 HE Scores ON TrvUE-Fause T s RI, RI, PI Pil 
rr i 
lest lest Pest Ie i 
as 
Reading ‘1 19 61 
|’ bole g il is 
\ st ts t take t I t ‘ 
In averadt 


The problems group slightly exceeded the reading erou}yp 
RI. RU, Pl. and PH The 


score on the achievement tests ‘ 


group exceeded the reading group hy fourteen poimts and the pr 
group by eleven points Again, there Is a slight tendeney for the 
bination group to exceed hoth the reading and the problems ¢ 
Due to the small number of cases used, however, the reliability 


differences between the mean seores ol the several vroups Is unkne 


combi 


ation 
yblems 


ol 


> 
3 
DAS 
Fx 
bats 
73 
2 
¥ 
= 
x 


JOURN OF EDUCATIONAL RESEARCH [ Vol. 26, No 


1/ 


CONCLUSION 


} 


On the basis of this small experiment, it does not appeal that the 
her of beginning educational statisties should use the reading or ih 
nroblems method alone, when the combination method appears to wiv 


even hetter results 


SECOND EXPERIMENT 

\s a result of the first experiment it was concluded tentatively that 
it Is probably more protitable to distribute one’s time bet ween problem 
solving and reading statistical literature (combination method ). The 
hest allocation of time between these two procedures was not, however 
determined. In order to secure information regarding the best distribu 
tion of the student's time between these two types of study the writer 
conducted a second experiment wherein the thirty students in his class, 
all of whom were evraduate students, were divided into three groups ol 
ten students, each group having equal average intelligence as measured 
on two group intelligence tests. None of the students had had previous 
training in edueational statisties. 

ach student in the reading group was to read for seventy-five minutes 
daily from a earefully prepared reading list and spend forty five minutes 
daily in working statistical problems. Each student in the problems 
group was to spend seventy-five minutes each day working statistical 
problems and forty-five minutes in reading statistical literature. Ever) 
member in the combination group was to spend sixty minutes daily 
reading and sixty minutes in working problems. The students turned 
in to the instruetor the problems worked each day and made a daily 
report showing the topics covered in their reading and the amount ot 
time given to each procedure. A eheck on the amount of time spent on 
the assignments daily indieated that each group spent an average of the 
allotted time plus or minus five minutes 

Che experiment was conducted according to this plan for six weeks 
durine which time three true-false tests were given. At the end of this 
period the same achievement tests In edueational statisties, employed in 
the first experiment, namely, RI and PI, were given. For the second six 
weeks of the experiment the reading and problems groups were intel 
changed. the combination group remaining the same. A check on the 
amount of time given to the assignments daily during th second term 
ndicated that each group spent an average of the allotted time plus or 


minus four minutes. During this period one true-false test was given, 
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making a total of four such tests (eontaimime 193 statements) during the 
experiment. At the en | of the second six-weeks period tests RIT and Pil 
were given. The re liabilits oft all the tests used was establishe cl in the 1 
experiment. It will suffice to sa) here that the coefficients of correlation 


were slightly larger in this experiment than in the first 


RELATIVE ACHIEVEMENT OF THE THREE GROUPS 

It may be observed from Table Il that the combination group slight!) 
exceeded the problems group on each of the four true-false tests. The 
combination group scored a little higher than the reading group In two 
of the four tests, scored equally with the re iding group on ome test. and 
slightly below the reading group on one test. The reading group seored a 
little higher than the problems group in three of the four tests, while the 
problems group slightly exceeded the reading group in one test. For 
the four tests, the reading group scored a total of 165 statements cot 
rectly, while the problems group scored only 157 statements corr ctl 
a difference of six statements in favor ot the reading group. The com 
bination group scored a slight advantage over both the problems and 
reading groups, answering a total ot 165 statements correctly. These 
differences are small, but again they favor the combination and the read 


ing groups In the order named 


Reading group 
Problems 
Combination 


There is no difference in the average seore of the problems group and 


the reading group on the achievement tests, each group scoring an avel 
age of 44 points out of a maximum Q5. The combination group exce eded 


the reading and problems groups each by six points. Again there is a 
tendeney tor the combination group tO ¢ xceed both the rendimg 


problems groups, but the amount ol the lifts renee Is sma | 
To offset the possible advantage that a eontinuity ol proces 


he to the combination group, the scores may he compared fol 


period of the experiment During the first six weeks o1 the ey 


true-Tais statements corres 


the reading group seored 105 1 


lems group, 103. and th eombination group 106 (on The 
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nent tests the reading group scored an average of 46 points, the problems 


vroup, Ol, and the combination “vrouyp, 51. In view of the small diffe: 


ences there seems to he neo choiee between the problems and the reading 


ws. but again the combination group either equals or exceeds each 


yrouy 


thre other groupes 


CONCLUSION 


Although these data are too meager to warrant any final conclusion 
the experiment slightly changed conditions does 


a repetition | 


sugvest that an equal distribution ot the student's time between working 
statistieal problems and reading statistical literature is slightly preferable 
to a larger proportion of his time being given either to reading or to 


working problems 
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rHE GOTHIC LETTERING SCALE FOR GRADING SLANTING 
FREEHAND LETTERING 


DARYL Braxncit MILL 


Sa Francisco, 


LETTERING is a subject which presents man) difficulties to the person 


who is endeavoring to put into practice the principles o1 objective grading 
It Is essentially a subject that has to be graded subjectively, but it 1s 


bv the 


possible to greatly reduce the reliance upon subjective judgment 


use ot a standardized seale. The **Cothie Lettering Seale’ has been 


constructed as a measuring device to evaluat lower 
ealled Reinhardt’ lettering 


ineline dl single 


stroke Gothie lettering or what is common!) 
there hy mak it possible to apply the ol objective eradl 


to the subject of lettering. 


METHOD OF CONSTRUCTING ALJ 


‘*Giothie Lettering Seale’ a lara number 


In econstrueting the 
lected irom veral high schools, from one 


specimens of | ttering were 
After a preliminary 


college, and from a tew professional drattsmen 
study, about 90 specimens of lettering were selected from the work of 
students and professionals and were used as a basis for detailed study 
Eight of these were picked us key samples. The remaining speenmens 
iy to merit, then each 
} 


il 


were roughly grouped into several sets accord 
or more of the key samples This tee 


group was compared with one 


nique was used instead of the technique of arranging the specimens m 
order from best to worst because the latter me thod seems to permit of a 
great lack of discrimination at the middle of the seale when a large 
number of specimens are rated. By frequent Cross ratings, It 1S hoped 
that any bias caused by any peculiar grouping of specimens may have 


been eliminated. 


In rating the specimens, the judges were instructed to tell whether 
those in a given group were better or worse than a given sample. TI 

judges were mechanical! drawing teachers, engineering professors, Uppel 
classmen in engineering and in the School of Architecture al the | 


versity of California. 
heen obtained The number 


After a large number of judgments had 
rly related 


of times that anv one specimen Was judged better han a nea 
Phis percentage Was then converte 7 


sample was expressed in percentage 
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GorHic LETTERING SCALI 
Numbers 14 and 15 of the seale 
Fert, that all rm wr caled 
4 P y t 7 wed Z 
WHenabhe 


Numbers 7 and 6 of the seale 
6 
We hold Féese fo 
he self-evident Phatal 
men aré-creared egva/ 


We these Srvths to 
se/fevident that all men 
are cregted egqua/ that they 
art endowed by thew Create thal they are 
with by thew Creator 
rights. cenmun uncherable rghfs. 


into values obtained from the Fullerton Cattell tables for the ‘* Pereep- 
tion of Small Differences.”’ These values were arranged in tables and 
after numerous arrangements, nine specimens were selected to form the 
Gothic Lettering Seale 
The Fullerton Cattell values between each pair of adjacent specimens 
to be seleeted for the seale are given in Table I. This table gives a 
eritical evaluation of each specimen in the seale. The first column in the 
table shows the arbitrary seale value assigned to each specimen. The 
second column gives the serial number of the specimen. In the third 
column is found the spacing between related pairs of specimens in terms 
of the Fullerton Cattell values. The mean of all interspacings in column 
three was computed. Then the difference between this mean and the 
Interspacings of each ndjacent pair ot specimens was listed in column 
four. The fifth column gives this difference expressed in percentages 
with the mean taken as a base of 100 percent. This column, then gives 
the amount of error in the placement of any given specimen and shows 
how much it varies above or helow its ideal position. The last column 
F. shows the true position of each specimen in seale values, evaluating from 
number 10 as a base From the data in this table, it is possible to 


critically evaluate the uniformity of the seale. 


4 
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In the compilation of the data m Table I. it was found that im on 


between the specimens could not be to ind 


nstance direct relationships 


To overcome this, it Was necessary to make indirect ealeulations by con 
paring several nearby specimens The value 2202 was ¢a culated for the 
space between 102 and 105. 

One further point should be considered as to the accuracy 0 ‘ 
seale. It is a matter of chance as to what the next rating on each spec 


men would have been. Had the next rating heen adverse, the position 


f the specimen might change noticeably in some eases. Upon computh 


0 
these changes it was found that one adverse rating would not serve sly 
change the position of any specimen In an unfavorable direction excep 
specimen 65. In case of specimen o2 at the hottom of the seale, one 
adverse rating would move it upward close to its correct position 

In order to determine the accuracy with which this seale could b 


used, an experiment was conducted. A eontrol group ol twentyv-sSIX spec! 
mens Was rated eight times with the seal These ratings were con 
pared with the statistieal values of the specimens as had been previously 


determined when computing the seale. 


TABLE I 


Tur SCALE VALUE OF EACH SPECIMEN IN ES 
Spa Het 
St 
Seca Nur r af lert Catt ) at 
tating Spe Value M 1) 
14 i 
2.104 
1 234 
2151 1 
Ve i 
11 
1¢ 6 
11 Isl 
64 ~ 
a 
10 
1 
i 
‘ 
Mea space het wee s u 
Phi us computed 


The results of these eight judgments are shown in Table II. The 
correlations range from 0.89 to 0.95 with an average of 95. Th findings 
shown in this table indicate that the seale is sufficiently accurate for all 


practical purposes. 
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TABLE Il 


I MENTAL GRADING OF TWENTY-SIX SPECIM WITH 
( nt ¢ 
elat betweer 
‘ ny ad Seore 
Mea Si ‘ nd ged Grades 
MM | ‘ ) 
wit i 2 af 
1.4 
i 10.1 158 
NX 77 
‘ 10.1 m4 
N l 
sit lg t bta aging t! 
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CLASSROOM USE OF THE SCALI 


described the construction of the seal nu tew comments 
should be made coneerning the use of the seale. The Gothie Lettering 
Seal used In the classroom as a erading device or as a device 
for creating motivation in lettering. As a grading device, it is used to 
nsure the teacher in keeping the same basis for grading at all times 
net only trom month te month, but from year to veat It is next to 
impossible to keep a uniform standard without some such measuring 
stick. When an isolated specimen of lettering is graded subjectively, the 
judge eannot eive it its absolute erade. but relates it to what has been 
judged immediate \ hefore Murt he rmore, a singel specimen rs graded 
alone at several different times, it is likely to be graded high at one time 
ind low at another time. This is a characteristic of subjective grading 

Ly using a standardized seale there is alWayvs a fixed standard to 
compare with at every level. Even when using these fixed samples as a 
basis of comparison there will be irregularity in grading. When using 
4 standardized seale, the irregularities will usually oe¢ur only in grading 
individual specimens. The mean of a elass will not vary as a rule far 
from the true position. When a very accurate grading is desired it is 
recommended that the specimens be graded three or more times either by 
different instructors or by the same instructor at different times. The 
median of these ratings will usually be very close to the correct scale 
value of a specimen 

To thoroughly evaluate the position of a specimen it should be slowly 


moved up the seale to a position where it seems to belong and, then again, 


: 


Way, 1933] THE GOTHIC LETTERING SCALI OSS 


if should he moved down the seale to where it seems to belong This pro 
cedure will enuse a second evaluation and results in a more 
crimination in grading a specimen, When a specimen ts simila 


scale sample in style but is really better or worse than the seale sampk 
this two-fold examination eliminates the bias caused by similarity betweet 
stvles The scale when used the way «it serib above greativ renhnes 
the evaluation of the grades in lettering 

As a device for motivation, it has been used by the author to great 
effect. A copy of the scale was placed on the wall at a convenient place 
where the students could have access to it at all times It was found 
that the students iked to see how well they were doing m comp Son 

ith the seale. Often they would go to the greatest pains to try to im 

prove their lettering, so they could attain a higher grade on the seal 
It is suggested that teachers place an improvement graph by the sid 
of the seale to further stimulate interest In Improvement 

In order to obtain standardized results, It Is necessary to use a un 
form procedure in viving the test. The first item of importance ts to Use 
» standard form for the lettering. The form used in collecting the spec 
mens for the seale required a fixed relation of long letters te short on 
Chis form ean be printed with the stock type of any printing o ita 
The use of a “"eu “is The torm should be pru tecl w 


ght blue light eyreen lines so) th it The lines WI | net obscure The 


When the results are to Tor stutistical reeore 
hlank for the needed information may be printed on. the hack I} 
ave should n twice as a che ek The form should hye nted 


1 good grade of paper that has been tested to ake India ink well 


DIRECTIONS FOR GIVING LETTERING rhe 


To obtain satisfactory results in the use ot the seale. it Is Important 
to induce the students into a cooperative spirit before a test Is given 
If this is not done, the test will not measure their true ability 

In order to further secure results that may be compared with the 
standard norms. the following procedure should be used when giving a 
test, 

1. Print the following passage on the blackboard 

‘We hold these truths to be self-evident, that all men are 
created equal, that they are endowed by thetr Creator with certam 


unalienable rights.”” 
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» Allow the students to practice this passage on scratch paper To 
ve minutes before giving the test Be sure that the time allowes 


is exact. Try to avoid giving the impression that this is a timed 


test. otherwise the students will not feel at ease. 

Next, pass out slips and have the students fill in the information 

that is ealled for on the back ot the eard. Say to the students 

Ise India ink. Keep the ruled side down until you are told to 
turn the slips over.” 

t. Then say, ‘Print the passage that I have written on the board 
ising lower Case letters. Use no capitals except those required by 
vrammar. 

> At the end of five minutes say, ‘*Stop, lay your pens down. I did 
not expect vou to finish.’ 


& Colleet these cards as soon as the ink has dried. 


PREPARATION OF SI ANDARDS OR NORMS 

Having constructed the seale. it was necessary to establish standards 
or norms Which would show what grade of work the students actually do 
1 the classroom when measured in terms of the seale. These norms are 
viven in Charts I, IL and IIT. They were constructed from samples 01 
students’ lettering which were obtained from eight high schools about 
San Franeiseo Bay and from the freshman ¢lass in engineering at one 0! 
the large western universities. The norms for the freshmen were taken 
before they had had any drafting in college. 

In scoring these, each specimen was grade d against the seale by three 
people who had had experienc in drawing and lettering. The median 
of these thre eradings was taken as the score of the specimen. Specimens 
were graded to half values when necessary These scores were classified 
and distributed on a basis of age, the number of terms of drawing that 
hac been taken, and on seve ral othe r bases as will be described shortly. 
For each of these distributions the means and standard deviations were 
computed, 

EXPLANATION OF CHART I 

Chart I gives the distribution by age. for high school students and 
college students. The ages represented in Chart [ are the mid-points. 
Thus the age of sixteen on the chart represents the age of all students 
hetween fifteen vears and six months and sixteen years and five months, 
inelusive. The mean, the standard deviation, the number of cases and the 


probable error of the mean are found in the enclosed **box’’ at the bottom 
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MIAN AN ANDAR VIATIONS 
1 
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+— + + + 4 
rer M 
1) 
of each grap! The lines in the graph show the position raphieal 
of the mean and sta dard deviation at each wat 
EXPLANATION OF CHART 1 
Chart I vives the means, standard deviations, ete for the distribu 
Tion ot high students elassified tor Thre i This 
that mechanieal drawing had been taken The tests were made at the 


end ot the term The lent! or thre high terms Was a e ovel 


the students at the end of each term 


five months. The average ave ol 


given below. 


Years ol Years and Months 


One Term 16.15 ol 16—1.8 


Two Terms... .. 16.45 ol 16-54 
Three Terms 16 OD ol lb 7 
Four Terms 16.80 ol 16-9.6 


EXPLANATION Ol CHART Il 


Charts I and II are valuable to on who understands the statistical 


Chart II has been pre pared to aid teachers who 


technique in grading 
This chart shows a five port grading 


are not versed in statisti ‘al method 
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svstem based on findings listed in Charts I and IT which may be applic 


many 
rhe wraph lines indicate the score at the values of plus one ai 
one lf sigmas, plus one-half sigma, minus one-half sigma, minus 1 


half siemas. from the mean. The actual percentages ot student 


and 
which fell in each group are indieated on the chart. The ideal statistic 


ereentages in each group are given in the following table. 


Excellent Work 7 percent 
NUMBER 
High School AGt College OF TERMS 
4 i7 18 18 20 
T 
+ + + + 
EXCELLENT EXCEYLENT) EXCELLENT 


S% % 


2% |} 


iGOOD 
41% 26% 
GOoD 
20% | 
Vo AVERAGE | 
O%% | 


>, Ave RAGE 


aV RAGE | 37% 
A 
; ; ; 
FAILURE | POOR 
54% | 26% 
~ + + + 
FAILURE | 
; ; ; 
1% 104% Flaicuré 
Th % 
Cuarr TI. A Five Grapinc System: BASED ON VALUES 
oF 1%. \&, AND lly SIGMA 


OBSERVATIONS ON CHARTS I, II, 1 
It will be noticed from these charts that age is an important factor in 
causing improvement in lettering. When it is remembered that the 
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iverage age ot students who have take n only one term ol draw ing Is ovel 
sixteen years, it is obvious that the younger students are at a decided 


if seems 


disadvantage if graded on a basis ot class average Therefore 
fair when grading to use the age norms only. This gives the younget 
students an even chance and also it does not cover up weakness in the 


work of older students 


FINDINGS OF INTERES1 

In collecting the material for the norms, other material was collee ed 
which has revealed some interesting tacts 

The first fact of interest relates to acceleration and retardation of 
students. There were 35 accelerated students and 170 retarded students 
included in Charts I and II. 

The range for normal students was placed at three half grades. Thus 
a student of the age of 16 vears and one month was élassed as norma 
he were in the high tenth, the low eleventh, or the high eleventh ora 
If this student were In the low tenth, he would be classified as retarded 


assitied as rated 


wid. if in the low twelfth, he would be « 

It was found in making the distribution of norma! students that much 
vreater improvement could be expected of them from age to ag than 
would be indicated in Chart I. Likewise, between the first and seeond 


+} 


the mt Col 


terms the normal students made more progress than 
tained the retarded students shown in Chart II After the third and 
fourth terms, scores of the normal students show little sienificance as 
compared to the whole group. This indicates clearly that re turded stu 
dents do. on an average, inferior work to normal students ind then 
presence materially reduces the class average 

A seeond interesting observation is that while the quality ot lettering 
inereases with age, the quality decreases with the amount ol lettering 
taken after the first vear. This would indicate one 01 three things, either 
that too little attention is paid to lettering during the third and fourth 
terms: that lettering becomes burdensome to the student and loses its 
motivation: or that only the poor students continue im the tl ird and 
fourth terms. <A short investigation conducted along this line indieates 
that the lack of improvement is due to inadequate motivation 

A last observation was significant as far as the administration of 
teaching time in the school was concern d. This deals with the influence 
ot giving drawing two periods a day. When all other tactors were 


eliminated, the number of eases was quite small, so that the conclusions 
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uit on the other hand there was a constant tendene 
the same way which seemed significant. The student 
“ia dav in drawing seemed to improve almost as muc! 
t two periods a day except during the first tern 
ited data collected would seem not to justify the time 
mis as Tar as lettering Is cone rned, 
that insufficient data were collected to study the speed 
u It is hoped that at some future time this can be 


published 
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MENTAL HYGIENE IN EDUCATION 


Ir the busy teacher, administrator, or research worker pauses from 
his labors tor a moment and VIews the whole preture of edueation he S 
overwhelmed with the multitudinous activities which beset him « 
sides Evervthing irom new methods ot teaching arithmett to new 
svstems ¢ ventilation Is In process of opment, and event he Is 
expected To glean the lmiportant features, Uses, and applications his 
dailv task of edueation, Yet among this contusing array we are Tinediiye 


only the beginnings of a movement which Is certam to become of ere 


significances the place ot mental hy viene education 
In self-defense we mas heheve that this movement Is really nothing 
new. and that we have been practising it regularly tor years While ou 


defense rationalization Is true to some extent and without the formal 


name of mental hygiene, as vet we have not begun to understand its 
significance, much less to put It Into universal practiee mM the daily routine 
of the school. The sources of difficulty lie in the misinterpretation and 
misunderstanding ot the actions o1 children and in our inability to always 
see problems through the eves of the child. Through the lack of undet 


standing we pile up more problems because the «l ile wm required Ta accep 


adult dietums by moral, mental, on physical bares 
There are two ivpes ol children to whom mental hvwiene Is equired 


rhe first has to do with the normal, average ehild and his daily program 


in and out of school; the second deals with the unusual case whi incluly 
tries the patience ol thie school, upsets its routine, and becomes bh nded 
as the blaekshe« }) The two Types differ more m degree thar n kind 
and the tundamental mechanisms of mental hygiene apply to beth o 
them 

In dealing with the average ehild the classroom teacher must have 
sympathetic and understanding pomt of view toward children thes 
ure to bn happy nt their work Two extremes are to he avoided im 
balanced mental hy giene program : the one leans in the direction ot he 
striet “‘school ma‘am”’ tvpe whose word is law, and silence and ordet 
are maintained. No one knows what price her pupils pay, possibly im 


revolt toward authority in their adult lives which eauses them to soon 


leave an job or position in which there Is even a hint of cdietatorial 
autocracy The other extreme of too great leniency is equally bad 
engendering disrespect for any authority or leadership a id the develop 
ment of a false and rficial n childre Possibly TIS We that 


mst 


vig 
Van 
- 
a 
gee 
i 


uy 
‘ 
i 


Hoo JOURNAL OF EDUCATIONAL RESEARCH [ Fol. 26, No 


t practieally no long-time follow-up studies to discover such 
effects llow to mix the right amount of friendliness with the right 
amount of firmness in dealing with children is an art which needs to bh 
cultivated. We must learn to what extent it can be acquired by teachers 
ane how its prarte ntialities mia he mu asured The effects should he known 
of too much eoaxing, or the results of ridieule, or of the effects of a con 
tinuous flow of empty words of praise and various other practices in 
daily teaching which are now seldom open to question mueh less are thes 
the topic of scientifie investigation. 

The diserepaney between the teacher's point of view on the individua 
pr blem ehild and that of the psychologist and social worker continues 
to be a stumbling block in the therapeutic program for unusual behavior 
eases. To the teacher, John. age 12. in the fifth grade, is the sole dis- 
turber in the class, he bullies the vounger children, he cheats, is noisy and 
impudent, is tardv and absent more than all of the others combined, and 
takes no interest in his school work. Nothing, from threats to kindness, 


ppears to have any effeet upon him When viewed from the classroom 
pom? of ow he Is 2 Serious problem, and some drastie and immediate 
teps need to be taken to cure him or remove him before his class becomes 


the foeal point of chaos From the standpoint of mental hi fiene he is 
showing what is enalled ‘symptomatic’ behavior, which means that his 
actions are the results of certain mental forees and emotions and not 
merely the outeroppings of native badness or some similar natural tend 
ency to become a hardened criminal. Further analysis will probably 
show a mild vision defect sufficient to Impawr active reading and grave 
enough to lower his Vitality to the pom oft be ing somewhat nervous At 
twelve he is the size of a fourteen vear old with the mind of a ten vear 
ich makes for a conflict in his social interests and his actual menta! 
capacity \dded to these physieal symptoms he comes from a home in 
which two older sisters have been model students and he constant \ hears 
so much about it that he hates both his sisters and sehool as well ILis 
father, who is a successful business man and who attributes his suecess 
to hard work rather than to greater ability, does not understand nor 
sympathize with him, and, as usual, John’s mother shields and proteets 
her son. He naturally drifts into the association of questionable com 
panions who are in the same predicament and who therefore ean under- 
stand him. Eventually he leaves sehool with no real preparation, and 
with very gross feelings of injustice Ile joins the ranks of those who 
delay pei ing their school taxes His case is by no means the exception ° 
in slightly less aeute form there are thousands of such children. They 
do not belong to special Classes ; they are within the realm of normal, 
average children, but their emotional life is badly misunderstood by the 
school 

There are many implications in John’s case. The teacher needs to 
know the background of such children, and be able to interpret it in 
terms of the child’s feelings and emotions. Either she or some agent 


lau, EDITORIAI! Hol 


from the school needs to diagnose and interpret this problen 0 
parents and preferably hefore the acute emotional problems have ade 


veloped sv no means has the school done its duty if it contents 
with doing a poor job of teaching him a little arithmetic and reading 
then sends him out ot the school at the « nd of the seventh grade w 
tangle of emotions ; nd anti social attitudes which he now possesses 
} 


Problems involving mental hygiene ean he solved. Thev must be 
terpreted in terms of the teaching situation, the gap must in bridg 
hetween what is known about such children clinieally and what happens 


in their daily routine When added to all the other modern problems 
ntal hy applied education looks like a order but 1 


large! than thie challenge which misunderstood ehildren now present 


intelligent and progressive edueationa mis 


NEW ATTACKS ON THE PROBLEM OF ORGANIZING 
INSTRUCTION 
Tul observe) remem) rs his feeling of shocked SUPprimse at an assel 
tion made by Doctor W. T. Harris about forty years age Ile was dis 
cussing the organization of the course of study for the lower clemen 
grades ot the St. Lowis Schools and his statemen 
Chips oft knowledae are all we can give to fhesne ¢ hildren 
If he had said grams ot knowledge instead ot chips shock wou 
have been less. for then there would have been the 
‘hers in St. Louts 


ready to grow Even at that time the kindergarten teache 
idea Teaching in the 


ile; 


were showing that chips did not give the tru 
primary grades has advanced far on the wal toward continuity im torts 
years. Nevertheless we have not alwavs wad inced toward the ceonecept 


a constanth crowing power to learn to Use thie knowled a ina skill 
nurtured in each pupil. 

Continuity is a quality which belongs to the 
learning situation 


teaching tuation Tol 


it is essential to the immediate Peachine and learn 


ing coalesce to heeome one common situation a 
‘+h ties it up with usalle meaning 


S pupil al i] tenchel Jom 
in that conquest of understanding whi 
ine eounects directly 


Of course there is continuity when th usable mean 
with the understanding of how to attack the next diffieulty m turthet 
learning. 

There is. also, another continuity which ts built 
nation as a Whole when the organization makes I possible to coordinate 
the activities of individual initiative with t 
study, and thus connect new attainment with a use of it as an added 
equipment for personal life. 

About twenty vears ago, the observer made : 
ach of whom had a different 


found and ported the 


me the school sit 


j ot re parts 


paring the class work under good teachers ¢ 


kind or degree of preparation for teaching 
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vork of | the naturally good teacher without formal preparator 
training. (2) the able teacher with good normal school training; (5) the 
teacher ot fine artistle power to compose a reeitation in which each pup 
lan attive place and the whole was a unique harmony of all as ; 
working unit whieh naturally seemed just to grow that way; and finally 
$) the genius teacher of wide training and experience who coordinated 
the activities of the individuals of the class into a complete society 0 
working minds guided by a common purpose, 

Research is always required for success in guiding a natural ac 
tivity What observable results follow from such an activity? How 
ean the activity itself be measured? When guided, how much of th 
power Is lost in wasted efforts? Sueh questions are concerned with faets 
and with their relations to other faets in a way to explain results and 
to Stlvgvest possible changes 


A simple illustration of the kind of facets the research worker in 
education finds of value comes to the mind of the observer from a tre 
quent experrenee of his tl children less than three years old \s 
they learn to count the number of things used together, such as the eup 
plate, knife, fork, and spoons, used at the dinner table, he has ofte: 


bserved the following situation 


Having been taught the names of the numbers from one to ten on 
welve, and learned to repeat them in ordered sueecession es he handles 
i like number of bloe¢ks: and having but three or four things about his 
plate, the ehild will count and reeognize that he has numbered these 
things. But let there be six or seven things and he will repeat the num 
bers for counting without reeognizing that he is to get the number for 
em all, and will continue to count toward ten until he suddenly recog 
nizes that he is saving numbers for which there are no thines before him 

I) This observation there are several hacts which need io be consid 
ered in relation to learning 

] In learning the names of numbers to ten or twelve, did the ehiled 
recognize tor the first four or five numbers the relation of counting to 
know if he had four or five bloeks? And did he no longer think o* 


counting quantity as he learned the numbers bevond six 


Is there an 
relation to the sense power of the eve or ear of a person to recognize 
quantity differences up to six without having to eount each thing 
rhis power is the basis of the Morse Telegraph code, and may need to 


be recognized in teaching numbers and perhaps long words to children 
It is probable that sueh natural powers of the eve or ear, and of brain 
cell recognitions are to be considered with regard to the quickness o1 
slowness of individual responses of children in certain learning situations. 

2. In many more complex situations for learning there is a relation 
of vocabulary or of other preliminary condition, which needs to be fre 
quently checked as a guide to instruction. If part of a voeabulary ex- 
presses what Is naturally understeod, and other words have no roots 


‘ 
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t meaning in the child's experiences then the learning situation ane 

teachet pupil eontacts need to be readjusted for such words 
In the teaching of language, and of The eran matical relations of the 
parts of speech needed to msure vood usage, the observer has Tound 1 wh 
evidence ot Inadequate uncle rtanding of what use to make oi the powers 
natural to the pupils fer expression, al d how to meet the special diffi 
instances, not iral 


eulties due to the taet that wood IS, ih sore 


to at least a part of the pupils. In this subject there Is mate al fon 


hook on t aching The same may be sald of the teaching ot ending 
Phe eriticism may be true that at times th pupils are taught how ne 
To read: at least how not to antic pate ans satistaction of a true met 
tal hunger tor a community of ideas whiel may come trom reading ve 
inderstand and appreciate the author through this pe rsonal touch wit 
his work. 

The artist teacher, rred To above gained het results | 
the unity for individual and elass organization and also the necessary 
order in the presentation o! instructional material by w choa harmo 

thie work ot the elass step | st 


hetween thought and action carried 


to the purposed outeome The pu ect Was the buving of the mate rials 
and the dressing oT a doll to be sold at a bazaar at a price to covel 
ost. The costume was designed and the kinds of materials to be used 
Notice the two tv pes ot arithmetical thinking required 


were selected. 
list hye nted or meas 


First the amounts ot each kind of maternal n 


ived in terms of the selling units of each at the stores. There 
ine list som 


eight different kinds listed as the items on a purenhastil 
put MUST th listed i! Vi reais other 
Oniv whet 


were sole 


things were measured in Inches 
were counted by units but were listed in dozens, and so on 
the same material was used for different parts of the costume could the 
measures he added and the sum listed Tao. pure iis Second Was The 


problem of computing the column of prices 


the unit prices of the different things Since all items were 1 1 


in dollars nel cents, trom 


hrought 


inder the common unit of price, the corm e id be added to give the 
total cost ot material. 

There were, of course, individual ‘dren who had difficulty in think 
the arithmetical principles, Tin ehildre Wie could x<plamed eact 
step and thus aided the teacher to recognize what difficulties needed im 


dividual attention. The teache) and the class 
did an artistie piece of work. 
The tend nev at this time appears To by 


to put too ot the burden 


of organization ot mat rial and of the means needed Tol class tivil 
upon the teacher. The research workers are iowever, seeking To «ae 1e1 
aetivities tor the applies tion of the |e " 


mine some ot the relations of 


‘ needed means tol checking 


ing situations required, and to provide 
accomplish me nt and for locating dividual difficulties 
a necessary basis fol teacher traimimege 


equipment and supervision 
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H. Jud the history of the s lens 
I Amer in edu t nal leaders tres 
nee n the teachir of social science : 
and miscellaneous investigations, many 
nts tow: thering e 
expl itor eharacter n fr thy 
eet i The were 
m charge 
‘ nis ney ‘ 
fiy r t the Int lr 
Yearbook on Instructional Materials stitute of Teachers College, Col 
tee of the Department of Supervisors and ba RELL uni i ntr ! t 
Directors of Instruction in Minneapolis past ten vears; Stevens It 
the first of Ma eh, it Was voted to inter stitute at Den I | “ t ! 
late a vearbook on ‘Materials of In- — publish a st f aptitude test 
atr tion’’ between the vearbook on engineering st ents 
The Planning of Supervisory Pr vear pet to Merrill-P S 


701 


ae 
Ses 
fo 
<2 
2 
AM 
- 
Ay. 
4 


0 JOURNAL OF EDUCATIONAL RESEARCH Vol. 26, Ne 
detroit nsultation B of edueation in Kentueky; $7.5 
‘ ( t lr ersit wit ordinat n t state nstitut 
j ete the nit er ed tion in Geor mel $25 
‘ ~ 
‘ nt thre t the Ame in ¢ 
er nif riplete at 1\ strate systems 
\ ely t le nat n-w e stud s l ftinanes t 
es ‘ \ ter Vv vis scontinued 
In the fiel t ney el n 
the exceptior emerget 
t luriu mast 
iv nye | 
the 
rer eetea ‘ ‘ vas ly 
itted Among the nstitut i, 
t ‘ ‘ ‘ ! en 
wer Atlanta University 1 
oor vs if Social Work. earl for threo 
n on years: Dillard University. $12,500 f 
ene! ot two ve ~ Fisk Lniversit 
t t ersont othe 
475.000 over tw enrs LeMovne 
nts en =4 Morgan ( ue iW 
stitutier ni for Paine College, $1.5 
' ‘ leg £65.000 Emergen to ofl 
£177.00 The Board eave $6,000 t 
atu at | 
Colleges 
, During the ‘ ppropriations we 
I Leet One of t st 
e ne 
‘ t a ft oat nd lished | the H 
ern ire as follows 
tmet Is w Leonard V. Kovus nds in Ame 
t te nm Ss ned itior 


tion of white and eolored groups in the Paul Ht. Hanus, ** Opportunity and Ac 

‘ anecit mnplishment in Secondas Edue: 

4 


Vay, 19 RESEARCH NEWS AND 


Abraham Flexner, ‘* De Americans 


Really Value Edueation?’** 192% 


Charles H. Judd, ‘‘ The Unique Char 
eter of American Secondary Ed 
cation,’’ 1928S 

George S. Counts, ** Second: 


. 


tion and Industrialism,’ 


vestment: Secondary Edu 
Democraev,’” 1930, 
‘*The Wav Out 


John Dewey, 
cational Confusion,’’ 1951 

William Setehel Learned, ‘* Realism in 
American Edueation,’’ 1952 


H. C. Morrison, ‘*The Evolving Con 


mon School.’’ 1955. 


Report or the eu of Seconda 
Educatior In the letter of transmittal 
h No, 22 of 


which appears in Monogray 
the National Survey of Secondary Edu 


eation, Commussioner Cooper makes 


very pertinent stutement concerning the 
organization and scope of the survey 


‘*Within a period of thirty vears the 


high-school enrollment has increased tron 


a little over 10 pereent of the population 
of high-school age to more than 50 per 
cent of that population. This enrollment 


is so unusual for a secondary school that 


it has attracted the attention of Europe, 


where onlv S to 10 percent attend second 


arv schools. Many European educators 
have said that we are educating too many 


I believe, however, that the peo 


people 
ple *f the United States are now getting 


a new conception of education Thev are 


coming to look upon ed ation as a 


preparation for itizenship and for daily 
life rather than for the monev return 
which comes from it They are looking 
upon the high sel ool as a place for their 
bovs and girls to profit at ape riod when 
they are not vet acceptable 

‘+In order that we mav know where we 


stand in secondary eduesrtion, 
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its organization its eurrieulun nelud 
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jeets, and particularly those subjects on 
which a comparison could be made be 
tween the present and earlier periods; its 


extracurriculum, which is almost entirely 


new in the past thirty vears; 


the pupil 


population ; and administrative and 
supervisory problems, personnel, and 
etivities 
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THE TEACHING OF GEOGRAPHY 


The Thirty-Second Yearbook 
of the National Society for the Study of Education 


Prepared by the Society's Committee on the Teaching of Geography 


Robert M. Brown, Earl E. Lackey, Edith Parker, Douglas Ridgley, DeForest Stull, 
Zoe Thralls, W. C. Bagley, and A. E. Parkins (Chairman) 


Assisted by Numerous Members of the Society 


This great yearbook was made possible by stout and continued 
assistance and cordial support of the National Council of Geography 
Teachers. Proposed originally by Miss Flora Nettleman of Toledo, fost- 
ered further by Dr. Ernest Horn and Dr. W. C. Bagley, the undertaking 
began in May, 1930, under the direction of the Society’s Yearbook Com- 
mittee on the Teaching of Geography composed of the following: 
Professor A. E. Parkins (chairman), Professors R. M. Brown, Earl E. 
Lackey, Edith Parker, Douglas Ridgley, DeForest Stull, Zoe Thralls, and 
W. C. Bagley. 

Dr. Guy M. Whipple, Secretary of the National Society for the Study 
of Education and Editor of the Society’s Yearbooks, says in his Editor’s 
Preface, “Seldom, if ever, has the Society produced a yearbook that repre- 
sents so nearly a consensus gentium—the gentes here being that large group 
of individuals professionally concerned with the place of geography in the 
program of education.” 


The titles of the six sections are: 


Section I. The Development of Geography and Its General Contribu- 
tion to Life 

Section II. Developing the Science of Teaching Geography 

Section ITI. Geography in the Curriculum 

Section IV. The Curriculum in Geography 

Section V. The Teaching of Geography 

Section VI. Investigations in the Teaching of Geography 


Bound in one volume of 615 pages 
Cloth covers at $4.50 Paper covers at $3.00 


PUBLIC SCHOOL PUBLISHING COMPANY 
BLOOMINGTON, ILLINOIS 
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the teacher 
the textbook 


(1) 
(2) 
(3) 
(4) 


ACTIVE ELEMENTS THAT MUST BE COORDINATED 
TO ATTAIN SUCCESS IN TEACHING 


the pupil’s learning power 
the testing that measures the de 


velopment of a working use of the 


(1) The Teacher 
For summer teacher-training classes 
and for meetings of teachers-in-service 
during the school year we recommend 
the fifteen numbers of the Educational 
Problem Series in the fields of elemen- 
tary school instruction, secondary edu- 
eation, sehool management, educa- 
tional psychology, rural education, 
and logic. 
Of the Yearbooks of the National 
Society for the Study of Education we 
recommend particularly : 
The Teaching of Geography 
(32d Yearbook) 

The Teaching of Science 
(Pt. I, 31st Yearbook) 

The Teaching of Arithmetic 
(29th Yearbook) 

The Teaching of Reading 
(Pt. I, 24th Yearbook) 


(2) The Textbook 

Language in Use for Third, Fourth, 
Fifth, and Sixth Grades and English 
for Seventh Grade. Of this 
one successful teacher 


in Use 


great series, 


told her board members who were con- 
sidering ways and means of reducing 
costs of instruction, ‘‘If it were neces- 
sary, I could build all my courses, ex- 
cept arithmetic, around Language in 
Usel’’ 


pupil’s abilities 


(3) The Pupil’s Learning Power 


PUBLIC SCHOOL PUBLISHING COMPANY 


The Instructional Tests in Arith- 
metic and in Reading by Sangren and 
Reidy and Wilson are to be used by 
the teacher throughout the year. We 
urge you to refrain from following the 
example of one superintendent who 
gave the tests all at one gulp with no 
attempt at instruction between tests. 
When used as an instructional tool 
they show quickly to the teacher the 
points at which pupils begin to fail so 
that the teacher can use her time to 
the best advantage. 


(4) Educational Measurement 


Tests 
For general pupil classification and 
diagnostic survey testing, use the 


widely standardized intelligence and 
achievement tests for grades and high 
school and college. Our catalogues 
describe many forms used for specific 
resulis. Write for them! The Public 
School Achievement Tests cover ten 
elementary school subjects and have 
four separate forms. 


509-11-13 North East Street 


BLOOMINGTON, ILLINOIS 
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